PATENT APPLICATION 



IN THE U.S. PATENT AND TRADEMARK OFFICE 



November 29, 2004 



Applicant (s) : Simon FENNEY et al. 

For : EFFICIENT BUMP MAPPING USING HEIGHT MAPS 

Serial No. : 10/611 719 , Group: 2673 
Confirmation No. : 6086 

Filed : July 01, 2003 Examiner: Unknown 

International Application No. : N/A 

International Filing Date : N/A 
Atty. Docket No.: R&G C-359 



Commissioner for Patents 

P.O. Box 1450 

Alexandria, VA 22313-1450 

PRIORITY DOCUMENT TRANSMITTAL, AND CLAIM OF PRIORITY 

Sir: 

Applicant (s) hereby claim(s) the right of priority based 
on United Kingdom Serial No. 0308737.6, filed April 15, 2003. 

Enclosed are: % 
[X] A certified copy of the priority application in 

support of the claim of priority. 
[X] Acknowledgment Postal Card. f 



DHT/jp 




FLYNN, THIEL, 


BOUTELL 


Dale H. Thiel 


Reg . 


No. 


24 


323 


& TAN I S , P 


.C. 


David G. Boutell 


Reg . 


No. 


25 


072 


2026 Rambling 


Road 


Ronald J. Tanis 


Reg . 


No. 


22 


724 


Kalamazoo, MI 


49008-1631 


Terryence F. Chapman 


Reg . 


No. 


32 


549 


Phone: (269) 


381-1156 


Mark L. Maki 


Reg. 


No. 


36 


589 


Fax: (269) 


381-5465 


Liane L. Churney 


Reg . 


No. 


40 


694 






Brian R. Tumm 


Reg . 


No. 


36 


328 






Steven R. Thiel 


Reg . 


No. 


53 


685 






Donald J. Wallace 


Reg. 


No. 


43 


977 






Sidney B. Williams, Jr. 


Reg . 


No. 


24 


949 



Encl: Listed above 



BEST AVAILABLE COPY 



THIS RAGE BLANK (usptoj 





(sxroctp cPun3 




I Office | 




INVESTOR IN PEOPLE 



The Patent Office 
Concept House 



Cardiff Road 
Newport 



South Wales 
NP10 8QQ 



the undersigned, being an officer duly authorised in accordance with Section 74(1) and (4) 
the Deregulation & Contracting Out Act 1994, to sign and issue certificates on behalf of the 
mptroller-General, hereby certify that annexed hereto is a true copy of the documents as 
iginally filed in connection with the patent application identified therein. 



ccordance with the Patents (Companies Re-registration) Rules 1982, if a company named 
his certificate and any accompanying documents has re-registered under the Companies Act 
0 with the same name as that with which it was registered immediately before re- 
stration save for the substitution as, or inclusion as, the last part of the name of the words 
lie limited company" or their equivalents in Welsh, references to the name of the company 
is certificate and any accompanying documents shall be treated as references to the name 
which it is so re-registered. 



ordance with the rules, the words "public limited company" may be replaced by p. I.e., 



.L.C. or PLC. 



istration under the Companies Act does not constitute a new legal entity but merely 
the company to certain additional company law rules. 




Dated 



1 June 2004 



CERTIFIED COPY OF 
PRIORITY DOCUMENT 



THIS PAGE BLANK iusptoj 



PaSlffs Form 1/77 

Patents Act 1977 
(Rule 16) 



Office 



Request for grant of 

(See the notes on the back of this form 
an explanatory leaflet from the Patent^ 
you fill in this form.) 



1. Your reference 



Patent application number 
(The Patent Office will fill in this part) 




-P0 1/7700 uSQOfBu^l^s/ 



The Patent Office 




Cardiff Road 
Newport 

Gwent NP9 1RH 



Fee: £0 



AJR/46063 % £&C>) 



3. Full name, address and postcode of the or of 
each applicant (underline all surnames) 



Patents ADP number (if you know it) 

If the applicant is a corporate body, give the 
country/state of incorporation 



IMAGINATION TECHNOLOGIES LIMITED 
Home Park Estate 
Kings Langley 
Hertfordshire WD4 8LZ 
UNITED KINGDOM 



UNITED KINGDOM 



4. Title of the invention 



Efficient Bump Mapping using Height Map 



5. Full name, address and postcode in the United 
Kingdom to which all correspondence relating 
to this form and translation should be sent 



Patents ADP number (if you know it) 



Reddie & Grose 
16 .Theobalds Road 
LONDON 
WC1X 8 PL 



910 



01 J 



6. If you are declaring priority from one or more 
earlier patent applications, give the country 
and the date of filing of the or of each of these 
earlier applications and (if you know it) the or 
each application number 



Country 



Priority application 
(If you know it) 



Date of filing 
(day/month/year) 



If this application is divided or otherwise 
derived from an earlier UK application, 
give the number and the filing date of 
the earlier application 



Number of earlier application 



Date of filing 
(day/month/year) 



8. Is a statement of inventorship and of right 
to grant of a patent required in support of 
this request? (Answer 'Yes ' if: 

a) any applicant named in part 3 is not an inventor, or 

b) there is an inventor who is not named as an 
applicant, or 

c) any named applicant is a corporate body. 
See note (d)) 



Patents Form 1/77 



Patents Form 1/77 



9. Enter the number of sheets for any of the 

following items you are filing with this form. 
Do not count copies of the same document. 



Continuation sheets of this form 

Description i g 

Claimfo) 4 
Abstract 



7 

Drawing^) /x 



1 0. If you are also riling any of the following, 
state how many against each item 

Priority documents 

Translations of priority documents 

Statement of inventorship and right 
to grant of a patent (Patents Form 7/77) 

Request for preliminary examination 
and search (Patents Form 9/77) 

Request for substantive examination 
(Patents Form 10/77) 

Any other documents 
(please specify) 



11. 



I/We request the grant of a patent on the basis of this application. 



Signature 



Date 

15 April 2003 



1 2. Name and daytime telephone number of 
person to contact in the United Kingdom 



A J ROBSON 
020-7242 0901 



Warning 

After an application for a patent has been filed, the Comptroller of the Patent Office will consider whether publication or communication of 
the invention should be prohibited or restricted under Section 22 of the Patents Act 1977. You will be informed if it is necessary to prohibit 
or restrict your invention in this way. Furthermore, if you live in the United Kingdom, Section 23 of the Patents Act 1977 stops you from 
applying for a patent abroad without first getting written permission from the Patent Office unless an application has been filed at least 6 
weeks beforehand in the United Kingdom for a patent for the same invention and either no direction prohibiting publication or 
communication has been given, or such direction has been revoked. 

Notes 

a) If you need help to fill in this form or you have any questions, please contact the Patent Office on 0645 500505. 

b) Write your answers in capital letters using black ink or you may type them. 

c) If there is not enough space for all the relevant details on any part of this form, please continue on a separate sheet of 
paper and write "see continuation sheet " in the relevant part(s). Any continuation sheet should be attached' to this form. 

d) If you have answered 'Yes ' Patents Form 7/77 will need to be filed. 

e) Once you have filled in the form you must remember to sign and date it. 

f) For details of the fee and ways to pay please contact the Patent Office. 



Patents Form 1/77 



Efficient Bump Mapping using Height Maps 

This invention relates to a method and apparatus for 
generating bump map data for use in a 3 dimensional computer 
graphics system. 

Background to the Invention 

In the field of 3D computer graphics, detail is often 
added to otherwise smooth objects though the use of Bump 
Mapping, which was introduced by Blinn in his paper 
"Simulation of Wrinkled Surfaces" (SIGGRAPH 1978, pp286-292). 
This operates by perturbing, on a pixel -by-pixel basis, an 
object's otherwise ^smoothly' varying surface normal vector. 
Because the surface's normal vector is used when computing the 
shading of that surface, its modification can give the 
appearance of bumps. Figure 1 .shows a surface normal being 
perturbed. 

In Blinn' s technique, each perturbation is computed by 
first taking derivates of a bump displacement texture or 
* height map' and subsequently applying it to the original 
surface normal and surface tangent vectors. The height map is 
a simple array of scalar values that gives the % vertical' 
displacement or * height' of a surface at regular grid points 
relative to that surface. Typically these are represented by 
monochromatic image data, e.g. a bitmap, with the brightness 
of any pixel being representative of the x height' at that 
point. Standard texture mapping practices are used to access 
the height data. The normal perturbations and lighting 
calculations are done in global or model space. Figure 8a 
shows the application of Blinn' s method to an * illuminated' 
flat surface. 
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A more 'hardware friendly' method was later developed 
by peercy et al ("Efficient Bump Mapping Hardware" , SIGGRAPH 
1997, pp 303-306, (also US patent 5,949,424)). This directly 
stores perturbed surface normals in a texture map, often 
called a normal map. Unlike Blinn's method, these normals 
are defined in a local tangential coordinate space, which 
can be likened to the representation of parts of the earth's 
surface on a page in an atlas. In Peercy' s technique, the 
lights used for shading are also transformed into this 
tangential space and thus the shading calculations are also 
computed locally. This process significantly reduces the 
number of calculations required when using bump mapping. It 
has become popular in recent 3D hardware systems and is 
sometimes known as x Dot3 bump mapping' . 

To minimize the texture memory and, more importantly, 
memory bandwidth required by this procedure, it is desirable 
to compress the normal maps. Unfortunately many of the 
commonly used texture compression schemes are not suitable 
as they cause a loss of information that, when applied to 
the special case of normal maps, can cause an unacceptable 
degradation in image quality. Two methods that are 
specifically tailored to normal maps, however, are described 
in our International patent application No. WO9909523 - 
these typically still use 16 bits to represent each surface 
normal . 

This then leaves the task of generating the normal map. 
One popular method again uses an initial height map, as 
originally described by Blinn. From that height map, a 
normal map can then be pre-computed, prior to rendering, by 
taking the cross product of the local derivative vectors of 
the height function sampled at regular positions. For cases 
where texture filtering is required, e.g. those based on the 
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well-known MIP mapping techniques, the height map should be 
repeatedly down- sampled and the associated normal map re- 
generated to produce the multiple MIP map levels. Problems 
can arise, however, when applying the texture filtering 
techniques, e.g. bilinear or trilinear filtering, to normal 
maps . 

It should be noted that whereas the height map could be 
of relatively low precision - often as low as, say 8 or even 
4 bits per pixel - the normal map may require 16 to 3 2 bits 
per pixel. The pre-processing steps of generating and 
compressing the normal map and the process of using the 
compressed normal map in 3D rendering are shown in Figure 2 . 
In the generation phase a height map 2 is used for normal 
map generation 4. An optional compression step 6 may then 
be used to produce an output map 8. in the use of the map 
8, an optional decompression step is first performed on- 
the- fly before the map is used by shading calculations 12 to 
provide pixel data to an output frame buffer 14 . 

Also well known in the art is the aspect of texture 
filtering, primarily the application of bilinear or 
trilinear filtering, the latter as invented by Williams 
("Pyramidal Parametrics" , Lance Williams, Computer Graphics, 
Vol. 7, No. 3, July 1983, pp 1-11). Bilinear filtering is 
briefly discussed below, since trilinear filtering is just 
the blending of two bilinear operations. 

A 2D texture can be considered to be a vector function 
of 2 variables (U, V) . For simplicity in this discussion, we 
will assume that, for an NxN pixel texture, the values of U 
and V range from 0 to N. When bilinear filtering is applied, 
the pixel, or x texel', values stored in the texture can be 
considered to be representative of the points in the centres 
of the respective texels, i.e. at coordinates (i+0.5, 
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j+0.5), where i and j are integers and represent the texel 
coordinate of the particular texel. This is illustrated in 
figure 3 for texel (fj), the centre of which is indicated by 
*20' . At this point, in the texture, bilinear filtering will 
return the colour of that texel. Similarly, sampling at 
locations x 21' , *22', and *23' will return the colours of 
texels (i+lj), (ij+l), and (1 + 1,7+1) respectively. Now consider any 
sampling location within the square formed by "20', '21', 
x 22', and x 23', such as point x 24'. Such a point has texture 
coordinates (w„vj where z + o.5<u, </+l.5 and y+o.5< v, <j +1.5 - The 
texture values for any point in the square will be formed 
from a bilinear blend of the four surrounding texels. 

In particular, the process used in the art will be some 
simple variation of the following: 

U' := Us - 0.5;// Place stored texel value at centre of 
texel 

V := Vs - 0.5; 

Ui := floor (U' ) ; 

Vi := floor (V ) ; 

Ublend := U' - Ui; 

Vblend : = V - Vi ,- 

// Do 2 horizontal linear blends 

ColourO := LinearBlend (Texel (Ui , Vi) , Texel (Ui+1, Vi) , 
Ublend) ; 

Colourl := LinearBlend (Texel (Ui, Vi+1) , Texel (Ui+1, 

Vi+1) , Ublend) ; 

// Do 1 vertical linear blend 

Result := LinearBlend (ColourO, Colourl, Vblend); 
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The Ublend and Vblend values are thus in the range [0. .1), 
and can be most conveniently represented by a fixed point 
number of, say, 8 to 16 bits precision. 

Figure 4a shows hardware, typical in the art, that 
performs the first steps of the above bilinear algorithm. 
The requested sample position is input, '50', and the 
positions adjusted by « a texel, '51' via a subtraction. The 
'floors' of the coordinate values are computed, '52', and 
these define the texel integer coordinates,- '53', for the 
top left texel of the required set of 4 texels . The values 
are also subtracted, '54', from previous values to produce 
the blending factors for the bilinear operation, '55' . 

It should be noted that the colours in 3D computer 
graphics. are usually 4-D entities, having Red, Green, Blue, 
and Alpha (i.e. transparency) components. When the bilinear 
blending described above is performed, all four components 
of the various colour values are operated on in parallel . 
This is shown in the second stage of the bilinear operation 
in Figure 4b. The integer texel coordinates computed in 
*53', are used to access the four neighbouring texels, '60' 
thru '63'. Each of these has its own Red, Green, Blue, and 
Alpha components. In the example, there are four (usually 
identical) bilinear units, '65' thru '68', each of which 
computes one of the four colour channels using the blend 
factors, '55' . The individual scalar results are then 
recombined into the one resulting colour, '69'. 

Another known aspect of 3D computer graphics is that of 
fitting smooth surfaces through or near a set of control 
points. In particular we are interested in two types known 
as uniform B- spline and Bezier splines, as described in 
literature such as "Computer Graphics. Principles and 
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Practice'' (Foley et al) or "Curves and Surfaces for CAGD. A 
practical guide" (Farin) . 

Of particular interest to this application is the case 
of a bi -quadratic B- spline which has CI continuity (i.e. 
continuous first derivative) . A bi-quadratic B-spline also 
has the property that, for any point on the surface, a sub- 
grid of 3x3 control points is needed to evaluate that point 
and/or derivatives at that point. A one-dimensional slice 
though a section of a quadratic B-spline is shown in figure 
5. The points, *80', x 81', and '82' can be considered to be 
three adjacent control points in a row of the grid'. The 
region of the curve between x 85', and *86' depends only on 
these three control values (and the neighbouring 6 values in 
the 3x3 sub-grid in the case of a bi-quadratic surface) . 

One popular way of evaluating such a curve is to first 
convert it to the equivalent Bezier representation, i.e. a 
different set of 3 control points, and then apply the de 
Casteljau algorithm which uses repeated linear interpolation 
(see Farin) . For the simple case of quadratic curves, this 
amounts to using a new set of control points which are. '88', 
x 81' (i.e., it is re-used), and *89'. Points x 88' and '89' 
are just the mid points of the connecting line segments and 
could be found by simple averaging. 

For the conversion of a bi-quadratic B-spline surface , 
the 3x3 grid of control points can be replaced by an 
equivalent set of 3x3 Bezier control points. Ah example 
showing the situation for a bi-quadratic surface is shown, 
in plan form, in figure 6. The original 9 . B-spline control 
points, one example of which is shown by v 100', are 
converted into the equivalent Bezier control points, such as 
x 101' . Stating this more precisely, if the grid of 3x3 B- 
spline points are: 
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.Equation 1 



Referring again to Figure 6, the region of interest is 
the central ^square', i.e. a position specified by («,v) , 
where 0<m,v<1 . In the case of a bi-quadratic surface, one 
method based on de Casteljau would be to bi- linearly 
interpolate sets of 2x2 neighbouring control points, using 
(m,v) as weights, to produce a new set of 2x2 intermediate 
control points. One of the four sets of 2x2 intermediate 
control points is indicated by *102'. These four results 
are, in turn, bilinearly interpolated, again using the 
weights, to produce the surface point. If tangents to the 
surface are required, a method such as given by Mann and 
Rose ("Computing values and derivatives of Bezier and B- 
spline tensor products'', CAGD, Vol 12, February 1995) can be 
used. For the bi-quadratic case, this can be done by 
performing additional linear interpolations using the 2x2 
intermediate control values. Finally, taking the cross 
product of these tangents generates the surface normal . 
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The height map defines 'height' values only at certain 
sample locations and so a means of computing the height 
surface at other points is required. In particular, bump 
mapping requires the surface normal which, in turn, usually 
implies the need for surface tangents. Blinn points out that 
the surface height is not actually required and proposes a 
function that only computes tangents. He notes that in order 
to avoid discontinuities in the shading, his tangent 
functions are continuous. Using the 3x3 grid of height 
samples shown in 6, Blinn' s function performs 3 bilinear 
blends respectively of the top left, top right, and bottom 
left neighbours, and then computes the differences of the 
top left and top right result and the top left and bottom 
left result as part of the tangent generation. 

Although Blinn' s function results in a continuous 
normal, its derivative can have discontinuities. 
Unfortunately, the human visual system is very sensitive to 
changes in the derivative of image intensity, and so 
* artefacts' can be seen. The method also tends to emphasise 
the underlying grid of the height map, which can be seen in 
Figure 8a. (For the sake of comparison, Figure 8b 
illustrates the result from a preferred embodiment of the 
present invention) . 

Although the introduction of Peercy et al's pre- 
perturbed normal map method makes bump mapping more 
practical in real-time hardware, it still requires 'large' 
texture formats as well as the separate pre-processing step 
to convert a height map to normal map. The 'large' texture 
formats consume valuable bandwidth as well as memory and 
cache storage and, although special normal map compression 
techniques exist, these formats are still often larger than 
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the original source height map. Also filtering of the normal 
map may also be problematic. 

A further limitation of Peercy et al's technique is 
that dynamic bump mapping, i.e. where the bump heights are 
computed frame-by-frame, is far more difficult to achieve. 
For example, the height values may be generated as the 
result of a separate rendering pass. The pre-processing 
step, including generation of the various MIP map levels, 
may take too much time to allow real-time rendering. 

Finally, it is beneficial to use a height function with 
C2 (or higher) continuity so that the normal interpolation 
is CI (or higher). In particular, it is important to have an 
inexpensive means of producing this function. 

Summary of the Invention 

We have appreciated that it is possible to implement, 
in hardware, an additional set of functions that provides an 
efficient means for direct transformation of a height map 
into filtered perturbed surface normals that have CI 
continuity. These normals can subsequently be used for 
various rendering purposes such as per-pixel lighting. In 
particular, we have devised a method which, by re-using 
colour texture filtering hardware that is ubiquitous in 
today's graphics systems in a new way with the addition of 
some small processing units, achieves the functions needed 
to compute the normal from a smooth surface controlled by a 
set of heights. Thus the data can be generated 
substantially in real time. 

The filtered surface normals are created y on demand' 
and are not stored. This provides the joint benefits of 
reducing the amount of texture data and bandwidth needed for 
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bump mapping, as well as overcoming some of the issues with 
the filtering of normal maps. This feature is also important 
when using dynamic height maps in real-time rendering since 
a pre-processing step may be prohibitive. 

Embodiments of the invention keep the advantages of 
computing bump map-based shading in local tangent space as 
described by Peercy et al, (although it is not restricted to 
doing so), with the convenience of directly using Blinn's 
height map but with the option of using a function with 
higher continuity . 

Preferred embodiments of the invention will now be 
described in detail by way of example with reference to the 
accompanying diagrams in which: 

Figure 1 shows the process of perturbing surface 
Normals as described by Blinn; 

Figure 2 shows a flow chart of the pipeline used for 
Peercy et al's method described above; 

Figure 3 shows the relationship of bilinear filtering 
of a texture to the texels of that texture; 

Figure 4a shows an overview coordinate calculation 
device in typical prior art bilinear hardware ; 

Figure 4b shows an overview of prior art hardware that 
applies the bilinesar blending to the addressed texels ; 

Figure 5 shows a segment of a piecewise quadratic B- 
spline curve, or equivalently, a section through a bi- 
quadratic B- spline Surface; 

Figure 6 shows a plan view of a section of a height map 
being interpreted as a bi-quadratic B-spline surface; 

Figure 7 shows an overview of a hardware system 
embodying the invention with modifications to support normal 
generation from height maps; 
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Figure 8a -shows the results of bumping mapping using 
Blinn's height map derivative function, while Figure 8b 
shows the function used by a preferred embodiment; and 

Figure 9 shows some alternative filter patterns that 
could be used for computing derivatives of a bump map. 

Detailed Description of Preferred Embodiment 

The preferred embodiment will now be described. 
Access is provided to height map textures, which store an 
array of height values, using preferably 4 or 8 bits per 
texel. Each value will encode a fixed-point number with some 
number of fraction bits - preferably 1/4 of the bits will 
be assigned to the fractional part. 

The embodiment fits a bi -quadratic B-spline through 
this set of points, thus giving the virtual height map 
texture CI continuity (i.e. continuous first derivatives). 
In Figure 5, the points *80', x 81', and *82' represent 
three adjacent height values/control points in a row of the 
height map. The value in the texture is allocated 
(preferably) to the y dimension while the other coordinate 
values (i.e., x and z) are implicitly defined by the texel's 
coordinate position. Alternative embodiments may assign 
these dimensions in some other permutation. The other 
control points needed for the surface in the texel region 
are shown, in plan form, in Figure 6. 

The manner in which the normal is computed is now 
described with reference to Figure 7. As with the standard 
texture filtering system described above, i.e. Figures 4a 
and 4b, it is assumed that the texture base coordinates to 
which the texture is to be applied will be calculated and 
supplied as before, at '50'. Modified address unit x 150' 
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then computes the x base' texture coordinate, '53', and blend 
factors x 55', in a manner that is similar to the prior art 
method described with reference to Figure 4a, except that 
step '51', the typical subtraction of a half-texel 
dimension, is bypassed when performing height map bump 
mapping . 

A modified texel fetch unit, x 151', which in Figure 4b 
consisted of units *60' thru x 63' which obtained four sets 
of RGBA vectors, is enhanced to be able to fetch a 3x3 set 
of scalar height values. In particular, it retrieves the 
following grid of height texels: 

Ut-iVj-i) {u n Vj-i) fa+uvj-i 

For brevity, these have be renumbered a, Jb, etc. 

It will be apparent to those skilled in the art that, 
with application of the address -bit interleaved texture 
storage format described in our British patent number 
GB22 978 86, such a height -map can be packed into the 
Equivalent', in terms of storage, of a colour texture of hi 
x M resolution of the height map. Each 2x2 group of scalar 
height data would occupy the space of a single four- 
dimensional colour. With such a format, the height map data 
can then be accessed using a very simple modification of 
exactly the same fetch mechanism used by units x 60' thru 
*63' in Figure 4a. 

The 3x3 grid of samples is then fed into the 
* Replicate' unit, 152, which outputs values to the Red, 
Green, Blue, and Alpha bilinear units. In particular, the 
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Red channel receives the top left grid of 2x2 scalar values, 
i.e. those fetched from... 



[;:] 



...while similarly the green channel receives the top 
right set, the blue, the bottom left, and the alpha receives 
the bottom right. Clearly some values, such as b' or e' , 
will be used more than once, thus the grids supplied to each 
unit overlap at least partially. 

Unit 153 takes the blend factors, x 55', and computes 

new sets of U and V blends as follows: 

_ _ 1 Ublend 
Ublend 0 = - + - 

• , Ublend . 
Ublend x = — 

„ , , 1 Vblend 
Vblend 0 =- + ■ 



Vblend x = 



2 2 
Vblend 



As Ublend and vblend are typically fixed point numbers, 
it should be appreciated that these * calculations' are 
completely trivial and incur no cost at all in hardware. 

These new blend values are distributed to bilinear 
units, x 65' thru 4 68' as follows: 

Red: (UblendO, VblendO) 

Green: (Ublendl, VblendO) 

Blue: (UblendO, Vblendl) 

Alpha: (Ublendl, Vblendl) 

This manipulation of the blend factors eliminates the 
need to convert from the quadratic B- spline control points 
to the Bezier control points, as described previously in 
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Equation 1. These bilinear units therefore effectively 
produce data which will enable surface normals with CI 
continuity to subsequently be derived. 

The results of the 4 bilinear interpolations are fed to 
the tangent construction unit, 155. This generates two 
tangent vectors, Tangl and Tang2 , which are functionally 
equivalent to using the following calculations: 

Tangl [X] : = 1 Texturesize; 

Tangl [Y] := Linearlnterpolate (VBlend, 

GreenResult - RedResult, 
AlphaResult - BlueResult) ; 

Tangl [Z] := 0; 
Tang2 [X] : = 0 ; 

Tang2 [Y] := Linearlnterpolate (UBlend, 

BlueResult - RedResult, 
AlphaResult - GreenResult) ; 

Tang2[Z]:= 1 Texturesize 
...where 

Linearlnterpolate (x, A, B) : = A + x* (B-A) ; 

For reasons that will soon be apparent, unit 155 actually 
only outputs three values : Tangl [y] , Tang2 [y] and 1 
Texturesize . 

Finally, in unit '156', the cross product of these 
tangents is computed. It should be noted that if the 
preferred embodiment is chosen, the presence of zeros in the 
tangent components simplifies the cross product to the 
following calculation : 
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N [x] : = Tangl [y] ; 
N[y] := 1 Textures ize 
N[z] := Tang2 [y] ; 

This vector is then normalised, preferably by squaring 
the N vector, computing the inverse of the square root of 
the result, and multiplying that scalar by the original 
components. The normalisation step may appear expensive, but 
it would be a requirement of any system that supported 
compressed normal maps, such as that described in WO9909523 
or British patent application No. 0216668.4. Thus, if such 
texture formats were already supported, the re -normalisation 
hardware would be reused. An example of the output of this 
embodiment is shown in Figure 8b. 

In an alternative embodiment, trilinear filtering can 
be adapted to support normal generation - the only 
difference in procedure will be that the values fed into 
tangent construction unit x 155' will be a x blend' of the 
values computed from two adjacent MIP map levels chosen. 
Other embodiments supporting improved anisotropic filtering 
are also feasible. 

In another embodiment, an interpolated scale factor may 
be applied to the deltas/tangents before normalisation so 
that a height map can be scaled differently for different 
models or different parts of the same model. 

In another embodiment, the blend factor adjust unit, 
153, is not used and the B-spline control points are 
converted to the equivalent Bezier representations according 
to Equation 1 in a modified x 152' unit. 

In another embodiment, the actual interpolated height 
value would be computed by including a third linear blending 
operation . 
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In another embodiment, Blinn' s height interpolation 
function could be employed. In this embodiment, the blend 
factor adjust unit, 153, is not used and it is unnecessary 
to use the bilinear 'alpha' channel. That also implies that 
it is unnecessary to fetch source texel x k' . The tangent 
unit, 155, then simplifies to compute the difference of 
'green' and 'red' and the difference of 'blue' and 'red' . 

In another alternative embodiment, dedicated sampling 
hardware could be included that takes numerous texture 
samples and applies an alternative derivative filter such as 
4 taps, Sobel, Prewitt, Parks-McClellan derivatives filters 
as represented in figure 9. 

In another embodiment, colour textures are also 
filtered using bi -quadratic B- splines, either through the 
addition of bilinear filtering units, or by iterations 
through the colour channels, whereby the individual weights 
to the bilinear units are adjusted according to the 
previously described embodiments. 
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CLAIMS 

1. A method for generating bump map data substantially in 
real time for use in a 3 -dimensional computer graphics 
system comprising the steps of: 

receiving data defining an area to which a texture is 
to be applied; 

receiving texture data to apply to the area, the data 
including surface height data; 

filtering each of a set of partially overlapping 
samples of the texture data; 

deriving surface tangent vectors from the filtered 

s ampl e s ; and 

deriving a bump map surface normal from the surface 
tangent vectors.. 

2. A method according to claim 1 in which the tangent 
vectors are defined in local tangent space. 

3. A method according to claim 1 or 2 in which the 
filtering step includes the step of using bi-quadratic B- 
splines to model a height surface from the surface height 
data . 

4. A method according to claims 1, 2, or 3 in which the 
filtering step includes the step of using existing hardware 
in the colour channels of the 3D graphics system to filter 
the overlapping samples of texture data. 

5. A method according to claim 3 in which the filtering 
step is modified with blending factors. 
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6. Apparatus for generating bump map data substantially in 
real time for use in a 3 -dimensional computer graphics 
system comprising: 

means for receiving data defining an area to which a 
texture is to be applied; 

means for receiving texture data to apply to the area, 
the data including height data; 

means for filtering each of a set of partially 
overlapping samples of the texture data; 

means for deriving surface tangent vectors from the 
filtered samples; and 

means for deriving a bump map surface normal from the 
surface tangent vectors . 

7. Apparatus according to claim 6 in which the step of 
tangent vectors are defined in local tangent space. 

8. Apparatus according to claim 6 or 7 in which the 
filtering means comprises a means to use bi-quadratic B- 
splines to model height surface from the surface height 
data . 

9. Apparatus according to claims 6, 7, or 8 in which the 
filtering means includes means to use existing hardware in 
the colour channels of the 3D graphics system to filter the 
overlapping samples of texture data. 

10. Apparatus according to claim 8 in which the filtering 
modifies the filtering with blending factors. 
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11. A 3D graphics system comprising a plurality of colour 
data processing means for generating data for use in shading 
an image to be represented by the 3D graphics system; 

means for supplying texture data to be applied to the 
image ; and 

means for assigning the colour data processing means to 
the generation of bump map data for use in applying the 
texture data to the image. 

12. A method for generating bump map data substantially in 
real time for use in a 3 -dimensional computer graphics 
system substantially as herein described. 

13. Apparatus for generating bump map data substantially as 
herein described with reference to figure 7 of the drawings. 

14. A method for generating bump map data for use in a 3- 
dimensional computer graphics system comprising the steps 
of: 

receiving data defining an area to which a texture is 
to be applied; 

receiving texture data to apply to the area, the data 
including surface height data; 

filtering each of a set of partially overlapping 
samples of the texture data; 

deriving surface tangent vectors from the filtered 
samples ; and 

deriving a bump map surface normal from the surface 
tangent vectors . 

15. Apparatus for generating bump map data for use in a 3- 
dimensional computer graphics system comprising: 
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means for receiving data defining an area to which a 
texture is to be applied ; 

means for receiving texture data to apply to the area, 
the data including height data; 

means for filtering each of a set of partially 
overlapping samples of the texture data; 

means for deriving surface tangent vectors from the 
filtered samples; and 

means for deriving a bump map surface normal from the 
surface tangent vectors . 
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